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5295134 INSPEC Abstract Number: B9607-6140C-572 , C9607-52 60B-4 39 

Title: A proposal of the synchronization method between drama image, sound 
and scenario document using DP matching 

Author (s): Yaginuma, Y. ; Sakauchi, M. 

Author Affiliation: Inst, of Ind. Sci . , Tokyo Univ., Japan 
Journal: Transactions of the Institute of Electronics, Information and 
Communication Engineers D-II vol.J79D-II, no. 5 p. 747-55 
Publisher: Inst. Electron. Inf. & Commun . Eng, 
Publication Date: May 1996 Country of Publication: Japan 
CODEN: DTGDE7 ISSN: 0915-1923 
SICI: 0915-1923 (199605) J7 9DII : 5L . 74 7 : PSMB; 1-3 
Material Identity Number: M973-96007 

Language: Japanese Document Type: Journal Paper (JP) 
Treatment: Practical (P) 

Abstract: Automatic content recognition and keyword extraction from 
video images is generally a difficult task, if we try it with only one 
video media. However, in some cases, we can utilize another related 
additional media. For example, a TV drama consists of not only video, 
but also sound and scenario document. In such cases, a much higher level of 
recognition and keyword extraction can be realized by integrating 
analysis of these multiple media. A synchronization method of relating 
multiple media using DP matching is proposed, and based on the results of 
synchronization between video, sound and scenario document, effective 
methods for the semantic decomposition, retrieval and higher level analysis 
of TV drama video are also discussed. The results of the experiments 
using several numbers of a TV drama reveal the effectiveness of the 
proposed method. (17 Refs) 
Subfile: B C 

Descriptors: entertainment; feature extraction; interactive video; 
multimedia computing; synchronisation; video recording; visual databases 

Identifiers: synchronization method; drama image; scenario document; DP 
matching; automatic content recognition; keyword extraction; video images 
; video media; multimedia; multiple media; semantic decomposition; higher 
level analysis; TV drama video 

Class Codes: B614 0C (Optical information, image and video signal 
processing); B6430H (Video recording); C5260B (Computer vision and image 
processing techniques); C6130M (Multimedia); C6160S (Spatial and pictorial 
databases) 

Copyright 1996, IEE 
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(c)2004 Japan Science and Tech Corp(JST). All rts. reserv. 

02316409 JICST ACCESSION NUMBER: 95A0348551 FILE SEGMENT: JICST-E 
Special Edition Image Processing in the Multimedia Age. Basic Functions 
Multimedia Information Broadcasting Service. 

SENOO HIROSHI (1); KAI KENJIRO (1); ISOBE TADASHI (1) 
(1) Jpn. Broadcast. Corp. Sci . and Tech. Res. Lab. 

Terebijon Gakkaishi (Journal of the Institute of Television Engineers of 

Japan), 1995, VOL. 49, NO. 3, PAGE . 336-34 3, FIG. 5, TBL.5, REF.10 
JOURNAL NUMBER: F0330ABG ISSN NO: 0386-6831 
UNIVERSAL DECIMAL CLASSIFICATION: 621.397+654.197 
LANGUAGE: Japanese COUNTRY OF PUBLICATION: Japan 

DOCUMENT TYPE: Journal 
ARTICLE TYPE: Original paper 
MEDIA TYPE: Printed Publication 

ABSTRACT: The basic functions of the new multimedia information 
broadcasting service, which interactively displays multimedia 
information, are studied. The system allows retrieval and viewing of 
the latest information such as news and weather anytime. Information 
can be decoded and displayed on various receiving display units 
including HDTV, personal computer, and PDA. Program data will be 
constructed by combining layout structure, logical structure and link 
structure to allow interactive viewing of detailed information and 
related items. Index data will be broadcast to provide user-friendly 
service. The index data will include a program table, keyword table, 
as well as category, keywords for each information. A technigue to 
automatically create index data is also studied. Based on the study of 
basic functions, an experimental system to broadcast through a 
satellite broadcasting data channel has been developed and its 
effects have been verified. The system is also promising as a future 
ISDB information service, (author abst . ) 

DESCRIPTORS: multi-media; duplex communication; television broadcast; 
information service; satellite broadcast; information retrieval; data 
storage 

BROADER DESCRIPTORS: information media; communication system; method; 

broadcast; telecommunication; service; retrieval; information storage; 

storage and accumulation 
CLASSIFICATION CODE (S) : ND12031N 
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INTERPHONE DEVICE 



PUB. NO. : 
PUBLISHED: 
INVENTOR (s) : 
APPLICANT (s) 

APPL. NO.: 
FILED: 
INTL CLASS: 
JAPIO CLASS: 

JOURNAL : 



02-206295 [JP 2206295 A] 
August 16, 1990 (19900816) 
FUKUDA KINYA 

FUJITSU GENERAL LTD [000661] (A Japanese Company or 
Corporation), JP (Japan) 
01-025428 [JP 8925428] 
February 03, 1989 (19890203) 
[5] H04N-007/18; H04M-009/00 

44.6 (COMMUNICATION -- Television ); 44.4 (COMMUNICATION 
Telephone 

Section: E, Section No. 996, Vol. 14, No. 496, Pg. 124, 
October 29, 1990 (19901029) 



ABSTRACT 

PURPOSE: To eliminate the signal line of a push button by converting a 
signal from the push button of an interphone device into a high frequency 
signal in a UHF band, mixing it to the antenna line of a television , and 
transmitting it. 

CONSTITUTION: When the push button of a bell of an interphone device is 
operated, a push button switch is operated, and the signal is impressed on 
a code signal generating part 7 and an oscillating part 8. The code signal 
generating part 7 generates the set code signal which identifies the 
interphone device. The oscillating part 8 oscillates the necessary high 
frequency signal in the UHF band of a television broadcast , a 

converting part 9 converts it by a code signal from the code signal 
generating part 7, executes a processing such as amplification as needed, 
and a mixing part 2 mixes the signal with the other TV signal. Further a 
receiving part 10 selectively receives the high frequency signal in the UHF 
band of the oscillating part 8, when it receives the normal code signal, it 
outputs a control signal to a channel control signal generating part 12, a 
television picture receiver 3 automatically switches a channel to the 
indicated idle channel , the TV camera of the interphone device picks up 
a subject , and a video is displayed. 
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WPI Acc No: 2000-263951/200023 

XRPX Acc No: N00-197448 

TV program related teletext program selection apparatus for multiplexed 
broadcasting system performs regeneration display simultaneously by 
selection display of teletext program of specific channel range 

Patent Assignee: TOSHIBA KK (TOKE ) 

Number of Countries: 001 Number of Patents: 001 

Patent Family: 

Patent No Kind Date Applicat No Kind Date Week 

JP 2000069384 A 20000303 JP 98237474 A 1998082 200023 B 

Priority Applications (No Type Date) : JP 98237474 A 19980824 
Patent Details: 

Patent No Kind Lan Pg Main IPC Filing Notes 
JP 2000069384 A 6 H04N-005/44 

Abstract (Basic) : JP 2000069384 A 

NOVELTY - The character data of each head line data of teletext 
information is compared with the extracted keyword , to obtain the 
program number of teletext program with same keyword from TV signal 
of different channels . When performing channel modification by 
main tuner, regeneration display is simultaneously performed by 
selection display of teletext program of specific channel range. 
DETAILED DESCRIPTION - A program genre detection unit (15) separates 
teletext information multiplexed with TV signal, to extract keyword 
from head line data of teletext program relevant to broadcast 
program . 

USE - For multiplexed broadcasting system. 

ADVANTAGE - Enables to chose teletext program relevant to TV 
program, effectively. DESCRIPTION OF DRAWING (S) - The figure shows 
block diagram of TV program related teletext program selection 
apparatus. (15) Program genre detection unit. 

Dwg. 1/3 

Title Terms: TELEVISION ; PROGRAM; RELATED; TELETEXT; PROGRAM; SELECT; 
APPARATUS; MULTIPLEX; BROADCAST ; SYSTEM; PERFORMANCE; REGENERATE; 
DISPLAY; SIMULTANEOUS; SELECT; DISPLAY; TELETEXT; PROGRAM; SPECIFIC- 
CHANNEL; RANGE 

Derwent Class: W03 

International Patent Class (Main) : H04N-005/44 
International Patent Class (Additional) : H04N-005/4 45 
File Segment: EPI 
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RECEPTION CONTROLLER, MEDIUM AND INFORMATION AGGREGATE 



PUB. NO. : 
PUBLISHED: 
INVENTOR (s) 



APPLICANT (s) 
APPL. NO.: 
FILED: 
INTL CLASS: 



2001-346117 [JP 2001346117 A] 

December 14, 2001 (20011214) 

MATSUMURA KOICHI 

SAGA MASAKI 

WATABIKI TOMOAKI 

TAKECHI HIDEAKI 

MAEKAWA HAJIME 

KATO HISANORI 

YAMAMOTO MUTSUKO 

IKEZAKI MASAO 

MATSUSHITA ELECTRIC IND CO LTD 
2000-163811 [JP 2000163811] 
May 31, 2000 (20000531) 

H04N-005/445; H04N-005/765 ; H04N-007/025; H04N-007/03; 
H04N-007/035; H04N-007/173 



ABSTRACT 

PROBLEM TO BE SOLVED: To solve a problem entailing high cost when a program 
in matching with the preference of each user is broadcast by using a 
channel exclusive to each user. 

SOLUTION: The reception controller is provided with a keyword entry 
section 102 that enters a keyword , a retrieval section 103 that acquires 
program information of a program relating to the keyword on the basis 
of the entered keyword , a program information storage section 104 that 
stores the acquired program information in cross-reference with a channel 
number of a remote controller, and a video receiver control section 
106 that controls a video receiver . When a user selects a channel 

number of the remote controller, the control section 106 acquires a 
broadcast channel number of a program that is broadcast at present from 
the program information related to the selected channel number of the 
remote controller and informs the video receiver about the broadcast 

channel number . 



COPYRIGHT: (C) 2001, JPO 
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INTELLIGENT VIDEO RECORDING AND REPRODUCING DEVICE 
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PUBLISHED: 
INVENTOR (S) : 
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APPL. NO.: 
FILED: 
INTL CLASS: 
JAPIO CLASS: 
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10-164471 [JP 10164471 A] 
June 19, 1998 (19980619) 
TANIGUCHI KATSUMI 
MIYATAKE TAKAFUMI 
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FUJITA TAKEHIRO 

HITACHI LTD [000510] (A Japanese Company or Corporation), JP 
(Japan) 

08-315909 [JP 96315909] 
November 27, 1996 (19961127) 
[6] H04N-005/765 

44.6 (COMMUNICATION Television ) 

R011 (LIQUID CRYSTALS); R101 (APPLIED ELECTRONICS -- Video 
Tape Recorders, VTR) ; R107 (INFORMATION PROCESSING — OCR & 
OMR Optical Readers) 



ABSTRACT 

PROBLEM TO BE SOLVED: To easily reserve the recording of desired program 
and to find out a program wished for reproduction by processing television 

program information through a storage medium or a network and inputting 

keywords such as the names of the characters. 

SOLUTION: An instruction to a video recording and reproducing device 3 is 
performed by interactive process on an operating picture indicated on a 
display 1 through the operation of remote controller 10 to an infrared 
light- receiving part 9. According to a recording and reproducing program 
190 stored in a memory 12, a CPU 13 controls all the actions of this device 
3. With the name of the character or the like as the keyword , a recorded 
program-retrieving means detects the program, including the keyword by 
comparing it through matching in the text code of program information. A 
video recording means records a program by interpreting the start/end time 
and G code of the recording-reserved program and at a recording related 
information display means, the number of recorded programs is displayed 
by keywords or the title of program, broadcasting station, the data and 
time of broadcasting and icon images are displayed by recorded programs. 
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10-098655 [JP 10098655 A] 
April 14, 1998 (19980414) 
KUROMUSHIYA KENICHI 
IKEUCHI HIROSHI 
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SHARP CORP [000504] (A Japanese Company or Corporation), JP 
(Japan) 

08-252119 [JP 96252119] 

September 25, 1996 (19960925) 

[6] H04N-005/44; G11B-015/02; H04N-005/445 

44.6 (COMMUNICATION -- Television ); 42.5 (ELECTRONICS -- 
Equipment); 4 4.2 (COMMUNICATION — Transmission Systems 
R101 (APPLIED ELECTRONICS -- Video Tape Recorders, VTR) ; R107 
(INFORMATION PROCESSING — OCR & OMR Optical Readers) 



ABSTRACT 

PROBLEM TO BE SOLVED: To provide a program retrieval device with a small 
calculation amount for the retrieval by which programs such as TV , CTV, 
teletext and radio programs are retrieved and reservation of programs are 
made simply and the retrieval is conducted even when a retrieval keyword 
is not completely accurate. 

SOLUTION: The device is provided with a database 2 in which program data 
such as program date and time, channel , program name, contents of program 
and performers are stored. A word relating to a desired program is 
entered by an entry means 1, a word dictionary 4 having a characteristic 
vector of each word is referenced, a characteristic vector corresponding to 
a question text from the entry means 1 is generated by a vector generating 
means 5, a retrieval means 6 calculates a distance between the 
characteristic vector corresponding to the program data in the database 
with the generated characteristic vector so as to retrieve the desired 
program. 
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TELEVISION RECEIVER WITH VIDEO MONITOR FUNCTION 



PUB. NO. : 
PUBLISHED: 
INVENTOR (s) 



APPLICANT ( s ) : 

APPL. NO. : 
FILED: 
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JAPIO CLASS: 



08-205043 [JP 8205043 A] 
August 09, 1996 (19960809) 
MIYAMOTO NOBUO 
KIMURA YOSHIMASA 
SAWAKI MINAKO 

NIPPON TELEGR & TELEPH CORP 
Company or Corporation) , JP 
07-010241 [JP 9510241] 
January 26, 1995 (19950126) 
[6] H04N-005/445 

44.6 (COMMUNICATION Television 



<NTT> [000422] 
(Japan) 



(A Japanese 



ABSTRACT 

PURPOSE: To realize the efficient utilization of time and saved labor of a 
viewer through the offer of the television receiver having a function of 
reporting the desired video information to the viewer when it appears on a 
screen . 

CONSTITUTION: A viewer registers a keyword a keyword related to 
desired video information by using a keyword entry section 9 in advance. 
A television video signal is recorded in an image memory 5 and a part 
with the same color and density of the image of a prescribed number of 
frames is segmented one by one character as a character pattern. The 
character pattern is converted into a character code string by a character 
recognition section 7 and collated with a registered keyword by a 
keyword collation section 8. As a result of the collation, when the 
registered keyword is included in the character code string, a beep tone 
generating section 11 generates a beep tone to report the fact to the 
viewer. Thus, it is not required for the viewer to always view programs and 
to allow the viewer to engage with other job. Thus, the time is used 
efficiently and the labor is saved. 
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TELEVISION RECEIVER WITH BUILT-IN INFORMATION RETRIEVAL REPRODUCING 
DEVICE 

PUB . NO.: 07-240881 [JP 7240881 A] 

PUBLISHED: September 12, 1995 (19950912) 
INVENTOR(s): SAITO ISAO 

HAMAGUCHI MASAKAZU 

TAKAHASHI HIROAKI 

TAKEUCHI TAKASHI 

ODA TOSHIYUKI 

APPLICANT (s) : HITACHI LTD [000510] (A Japanese Company or Corporation), JP 
(Japan) 

APPL. NO.: 06-029994 [JP 9429994] 
FILED: February 28, 1994 (19940228) 

INTL CLASS: [6] H04N-005/44; H04N-005/85 

JAPIO CLASS: 44.6 (COMMUNICATION — Television ); 42.5 (ELECTRONICS -- 
Equipment 

JAPIO KEYWORD:R101 (APPLIED ELECTRONICS Video Tape Recorders, VTR) ; R102 
(APPLIED ELECTRONICS -- Video Disk Recorders, VDR) 

ABSTRACT 

PURPOSE: To retrieve program information of a television broadcast 
program desired by the user from an optical disk recorded from the program 
information and to reproduce and display the retrieved program. 

CONSTITUTION: Broadcast information comprising program names, channel 
names, and broadcast dates and retrieval information relating to a 
program content are recorded on an optical disk medium 106 as program 
information of a television broadcast program. When an instruction 
keyword entry means 110 commands program retrieval, a program information 
retrieval pattern is displayed on a display screen of a television 
reception display device 102, and when a channel number and a 

broadcast date or the like are designated on the program information 
retrieval screen, the broadcast information is retrieved and a program 
genre selection menu is displayed. When a desired genre is designated, the 
designated channel number , the broadcast date, and a program list 

suitable for the genre are displayed on a retrieval result display menu. 
When a prescribed program is designated, a program information display menu 
representing the content of the television broadcast program is 
displayed . 
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Electronic programming guide which operates on computing platform 
associated with television - uses platform to access program listing 
database containing information for different television programs, and 
includes database containing viewer profiles and suggest module which 
generates preferred schedule using viewer profile 
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Priority Applications (No Type Date) : US 9734480 P 19970103; US 97943661 A 

19971003 
Cited Patents: No-SR.Pub 
Patent Details: 

Patent No Kind Lan Pg Main IPC Filing Notes 
EP 854645 A2 E 18 H04N-005/445 

Designated States (Regional) : AL AT BE CH DE DK ES FI FR GB GR IE IT LI 

LT LU LV MC MK NL PT RO SE SI 
JP 10207914 A 18 G06F-017/30 

SG 67469 Al H04N-005/445 

KR 98070327 A H04N-005/765 

US 6163316 A H04N-007/10 Provisional application US 9734480 

TW 435046 A G06F-017/30 

Abstract (Basic) : EP 854645 A 

The electronic programming guide for computing platform associated 
with a television , the platform operable to access a program listing 
database containing program listing information for a plurality of 
television programs, has a profile database for storing a viewer 
profile. A suggest module is coupled to the profile database for 
accessing the viewer profile and the program listing information and, 
in response, generates a preferred schedule according to the viewer 
profile and the program listing information. The preferred schedule is 
indicative of the desirability of a particular program relative to 
other programs . 

A profile module receives viewer preference information and, in 
response, generates the viewer profile. The profile module is operable 
to provide a preference template to the viewer for receiving the viewer 
preference information. The viewer profile includes a ranking 
corresponding to an option selected from the group consisting of a 
genre option, an actor option, a sports team option, and a keyword 
option . 

ADVANTAGE - Generates profiles for different viewers and likely 
schedule to appeal to each. Allows viewer to tune to more preferable 
programming at any time during viewing session. Viewer need not block 
entire channel to restrict viewing of undesirable programs to certain 
user such as child. 
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Television system for receiving several digitally encoded television 
programs - creates control signal and selects virtual channel in 
response to entered data, each channel is subject to re- assignment 
to different data transmission channel , schedule data defines each 
program relationship to transmission channels 
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Abstract (Basic) : WO 9519092 A 

The method for transmitting program information involves forming a 
master guide containing programme information for a period of less than 
twelve hours of current programming information. A special guide is 
also formed which contains programme information for a period equal to 
or greater than twenty-four hours, typically covering thirty days. 

The master guide is multiplexed with programme signals on multiple 
transmission channels . The special guide is multiplexed on one 
channel only, in addition to the master guide and the programme 
signal. Pref., the special guide is formed in a number of segments 
which are applied to a single channel . 



USE/ ADVANTAGE - Sa^^Lite TV system. Allows maste^^ide to be 

readily available on any channel to which receiver is tuned. 
Transmission of special guide on one channel minimises use of system 
bandwidth . 
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Electronic programming guide for television systems - has processor to 

control video display generator with user control commands to display 

program schedules in overlaying relationships 
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Abstract (Basic): US 5781246 A 

The guide is for use with a receiver for displaying programs on a 
number of user-selectable channels . A user controller issues control 
commands, including channel -control commands. A data processor 
receives the control commands and generates video control commands . 

A video display generator receives video control commands from the 
processor for generating and displaying a location menu on the 
receiver. The location menu identifies a program source or subject 
matter category associated with each channel . A virtual channel 
is accessible in the tuning sequence of the number of channels and 
the data processor causes the location menu to be displayed in response 
to a user control command to tune to the virtual channel . 

ADVANTAGE - Allows user to view different channels schedules on 
different portions of the screen. 
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Channel scanning method using subject searching or 1 surfing' method 
e.g. for TV receiver - using remote controller having number of theme 
keys and appts . for storing entered channel indicators corresp. to each 
theme or subject , and transmitting indicator signal to control channel 
selector 
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Abstract (Basic) : WO 9619074 A 

The method for searching for a spectrum of television channels 
involves storing in a memory two groups of channels for tuning of a 
television receiver. In the background of a television screen the 
program being broadcast is displayed. 



A selected one of group of channels is retrie^BI from the 

memory, and in a picture-in-picture window of the screen the programs 
being broadcast are sequentially displayed. The different channel 
groups relate to different subject or program types. 

ADVANTAGE - Allows user quick access to desired program type 
without having to scan channels individually. 
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